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METHOD AND SYSTEM AND ARTICLE OF MANUFACTURE 
FOR MULTI-USER PROFILE GENERATION 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0001] The present invention relates to the field of generating recommendations for a set of 
options based on user preferences for those options. In particular, the present invention 
relates to the field of generating recommendations for a set of options based on past patterns 
of option selection by users of those options. In greater particularity, the present invention 
relates to the field of automatically generating recommendations for viewing television 
programs based on past viewing patterns and preferences of a plurality of television viewers, 
all of whom do not need to be physically present in front of the television. 

Description of the Related Art 

[0002] A television program viewer often has more than a few choices from which to select 
a program for viewing, sometimes even having hundreds of such choices. Additionally, 
viewers often have preferences about what programs they like, in general as well as 
specifically. 

[0003] As the choices of programming increase, numerous methods for providing 
information regarding the content of the programming have been proposed. For example, 
United States Patent 6,115,057, to Kwoh et al., teaches extracting rating data from a program 
video segment, the rating data indicating a rating level of the program video segment. 
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[0004] United States Patent No. 6,020,883 to Herz et al. teaches developing customer 
profiles for recipients describing how important certain characteristics of the broadcast 
program are to each customer. From these profiles, an agreement matrix is calculated, 
embodying the attractiveness of each such program to each recipient based on their profile. 
[0005] United States Patent No. 5,585,865 to Amano et al teaches receiving a television 
signal in which genre codes are included. Amano '865 teaches comparing the broadcast 
genre code with an entered genre code for all receivable channels and, if a program exists for 
which the genre codes match, tuning in that channel. Amano c 865 also teaches tuning into 
channels having a past record of highest frequency of reception. 

[0006] United States Patent 5,945,988 to Williams et al teaches a method and apparatus for 
automatically determining and dynamically updating user preferences in an entertainment 
system. Williams '988 allows for a plurality of system users and provides for automatic 
detection of which of the system users is currently using the entertainment system. 
[0007] However, there is no teaching or suggestion in the prior art for establishing the 
identity of more than one person in a viewing area, either in front of or within a certain 
distance of a television or other entertainment system, and creating a composite user profile 
using those users preferences. The prior art does not teach or suggest a system which 
automatically detects the plurality of users and decides which shows are to be recommended 
or shown depending upon which shows are being transmitted during a time-frame that further 
meet or exceed a rating using a composite user profile. The prior art also does not teach or 
suggest recommending only those choices that receive high ratings from all the individual 
profiles. 
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[0008] Furthermore, the prior art does not teach or suggest automatically creating viewing 
recommendations based on changeable user preferences that depend, at least in part, on 
predetermined weighting factors set by the users. 

SUMMARY 

[0009] The present invention comprises a system, method, and article of manufacture 
suitable for automatically generating recommendations of a set of preferred entertainment 
options from a larger set of available entertainment options based on user preferences of one 
or more users present in a predefined viewing area. In an exemplary embodiment, the 
present invention relates to automatically generating recommendations for viewing television 
programs based on past viewing patterns and preferences of a plurality of television viewers, 
all of whom do not need to be physically present in front of the television. The present 
invention creates a composite user profile based on individual profiles for each user detected 
who is to be used in the composite. Differing methods of creating the composite user profile 
may be employed. By way of example and not limitation, each user's preferences may be 
weighted the same as each other user's, or users may have differing weights assigned to their 
preferences. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0010] These and other features, aspects, and advantages of the present invention will 
become more fully apparent from the following description, appended claims, and 
accompanying drawings in which: 
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[0011] Fig. 1 is a generally perspective schematic view of an exemplary embodiment of the 
present invention; and 

[0012] Fig. 2 is a flow diagram of an exemplary method of the present invention. 

DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 
[0013] In general, throughout this description, if an item is described as implemented in 
software, it can equally well be implemented as hardware. 

[0014] Referring now to Fig. 1, the present invention is suitable for use with an 
entertainment system 20 such as television 20a. However, entertainment system 20 can 
include radio, other audio entertainment, broadcast and non-broadcast audio-visual 
entertainment such as cable or satellite or DVD systems, or the like. Entertainment system 
20 comprises persistent data store 30 such as a hard drive or non-volatile RAM (NVRAM) 
capable of storing individual user preference data for up to a corresponding plurality of 
entertainment system users, generally referred to herein by the numeral "40." The user 
preferences further comprise view histories for each user 40. As used here, "view history" 
means an accumulation of entertainment options user 40 previously selected over some 
predetermined time frame. In a preferred embodiment, the system of the present invention 
may make an assumption that when user 40 selects a particular entertainment option, user 
40 likes it and wants the system to recommend similar entertainment options in the future. 
[0015] Detection system 22 senses when a user 40 such as user 40a or 40b is in a 
predetermined viewing area 11 proximate television 20a. As used herein, "viewing area" 
may include not only the physical space proximate television 20a such as viewing area 1 1 
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but one or more adjacent viewing areas as well such as viewing areas 12 and 13 desired by 
a user 40 with authority to make set viewing area 1 1 boundaries. 

[0016] Detection system 22 may be of any such system as will be familiar to those of 
ordinary skill in the detection arts, including by way of example and not limitation input 
devices such as a television remote, biometric devices, set top boxes having recognition 
systems, voice recognition systems, and the like, or a combination thereof. As used herein, 
"biometric devices" may include a voice recognition system, a fingerprint recognition 
system, a handprint recognition system, and the like, or combinations thereof. Face and 
Hand Gesture Recognition Using Hybrid Classifiers by Gutta et al and published in the 
Proceedings of the Second International Conference on Automatic Face and Gesture 
Recognition by the Computer Society of the Institute of Electrical and Electronic Engineers, 
Inc. and Maximum Likelihood Face Detection by Colmenarez et al published in the 
Proceedings of the Second International Conference on Automatic Face and Gesture 
Recognition by the Computer Society of the Institute of Electrical and Electronic Engineers, 
Inc. are two examples of biometric recognition prior art. 

[0017] Profile processor 34 is communicatively coupled to persistent data store 30 and 
detection system 22. As used herein, "profile processor" comprises a computer such as 
personal computer 34a, a microprocessor based system such as a microprocessor system 
embedded within or directly built into an entertainment system 20 such as profile processor 
34, an application specific integrated circuit, an external device such as set top box 26 
comprising a microprocessor based system, and the like, or any combination thereof. Profile 
processor 34 is capable of monitoring interaction of user 40 with entertainment system 20; 
recording that interaction with entertainment system 20 as well as the view history for each 



5 



US010281 

user 40; and creating, manipulating, storing, and maintaining user profiles in persistent data 
store 30. 

[0018] Using detection system 22, profile processor 34 automatically detects which users 40 
of the plurality of entertainment system users 40 are currently using entertainment system 20 
or are within viewing area 11 of entertainment system 20. Using these detected users 40, 
profile processor 34 automatically creates a composite user profile based on the profiles of 
each of the plurality of users 40 currently in viewing area 1 L 

[0019] Each user profile may comprise a view history as well as preferences for the user 40. 
Additionally, users 40 with appropriate access rights may be allowed to modify their profile, 
by way of example and not limitation selecting from a set of predefined preference 
categories. These categories may include genre of entertainment options preferred, e.g. type 
of music or television program type. Additionally, a user 40 may rank order entertainment 
options by user preference, time of day viewing preferences, combinatorial preferences, or 
the like, or any combination thereof. "Combinatorial preference" as used herein means a set 
of preferences about how to handle preferences of a user 40 in light of other users 40 who 
may be present in viewing area 11. For example, a given young adult 40a with small 
children 40c may not have a strong preference for children's cartoon programming but may 
have a profile preference that rates children's cartoon programming very highly if a three 
year old 40c is present in viewing area 11. 

[0020] Entertainment options that rate at or above a threshold value may be considered a 
"positive" program for a user 40. Accordingly, those entertainment options that do not rate 
at or above a threshold value may be considered a "negative" program for a user 40. Given 
the view history of a user 40, the system of the present invention generates a set of negative 
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entertainment options such as by sampling an available database of all entertainment options, 
where the database is of the type familiar to those of ordinary skill in the software 
programming arts. 

[0021] In an exemplary embodiment, the present invention uses a uniform random 
distribution to generate the negative entertainment options. By way of example and not 
limitation, the exemplary method selects each entertainment option from a database of all 
available entertainment options for entertainment options in the database that are not in the 
set of positive entertainment options for user 40. Additionally, this generation of the 
negative set of entertainment options may be limited, for example by a predetermined time 
frame, such as within a week from that day. 

[0022] Additionally, an adaptive technique may be used, such as disclosed in United States 
Patent Application No. 09/819286, by Gutta, et al, for An Adaptive Sampling Technique for 
Selecting Negative Examples for Artificial Intelligence Applications, filed 03/28/01. The 
adaptive sampling technique picks entertainment options more closer to the positive 
entertainment options and uses implicit, explicit, and feedback techniques for generating 
recommendations for individual users 40. Implicit techniques involve having a system being 
aware of what entertainment options appeal to each user 40, e.g. what each user watches or 
listens to; capturing the entertainment option preference patterns of the users 40; and 
recommending entertainment options based on those captured pattern options. As used 
herein, "capture" includes, by way of example and not limitation, storing predetermined data 
in the user profile for the user 40 such as in the view history of the user 40. Explicit 
techniques involve having users 40 specify viewing preferences and then using these 
specified preferences to recommend entertainment options to a user 40. A third technique 
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involves having a system elicit specific feedback from a user 40 and then generate a set of 
recommendations based on the feedback from the user 40. Additionally, a technique may 
be used that combines all the above. 

[0023] In the operation of an exemplary embodiment, as opposed to the prior art, the present 
invention addresses making a set of entertainment option recommendations based on a 
plurality of users 40, not just a single user 40. Accordingly, in one exemplary embodiment, 
the system first identifies each of the users 40 in viewing area 11 and then presents 
entertainment option recommendations limited to those entertainment options having a 
common rating by users 40 in viewing area 11, e.g. members of the household even if they 
are not physically present in the same room. By way of example and not limitation, if three 
year old user 40c mentioned above is not in the same room 1 1 as television 20a but is within 
line of sight or within hearing range of television 20a, such as in room 13, parent 40a of three 
year old user 40c may want to have the presence of three year old user 40c taken into account 
when having recommendations presented. For example, if three year old user 40c is in a 
kitchen and television 20a in a den adjacent to the kitchen, parent 40a may still opt to have 
children's cartoon programming more highly recommended than a movie station. 
[0024] When all users 40 in viewing area 1 1 are detected and identified, a profile for each 
user 40 identified is retrieved for further processing. Users 40 who are detected but not 
identified or who do not have a profile established may be represented by a default profile. 
The profiles of detected users 40 are then combined in a predetermined manner into a 
composite user profile and a list of entertainment option recommendations is generated and 
made available to users 40 in viewing area 11 that reflects the composite user profile. 
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[0025] In a first currently envisioned embodiment, combining profiles is accomplished by 
first accumulating positive entertainment options and generating negative entertainment 
options for each positive entertainment options for each profile retrieved for the detected 
users 40. A composite user profile is then created wherein each of the profiles of the 
detected users 40 is equally weighted in creating the composite user profile. The creation 
of the composite user profile may be by implicit, explicit, or feedback techniques or any 
combination thereof. The available entertainment options are retrieved from a database or 
other source of available entertainment options for a given time frame, e.g. currently or 
currently through the next two hours, and analyzed against the composite user profile to 
create a set of values for entertainment option recommendation. Entertainment options are 
selected from the set of all or a predetermined subset of all available entertainment options 
such as by recommending only those entertainment options being transmitted during the 
selected time-frame that are at or above a predetermined threshold value. In currently 
envisioned alternate embodiments, a user can be presented with a display indicating only the 
recommended options, all options in which recommended options are distinguishable such 
as visually, or a configurable set of recommended, positive options as well as non- 
recommended, negative options. 

[0026] In a currently contemplated alternative, instead of generating a composite user profile, 
the available entertainment options are analyzed and rated against a previously created (or 
default) profile of each user 40 present in viewing area 11. Only when an entertainment 
option is rated at or above a predetermined threshold value by all of these users 40 will that 
entertainment option be recommended. 
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[0027] Variations of this alternative are also envisioned. For example, each user 40 could 
be weighted differently such that preferences of certain users 40 are taken into account more 
than the preferences of other users 40. Additionally, instead of requiring that all users 40 rate 
an entertainment option at or above a threshold, a simple or weighted "majority rules" 
decision, or other rules based decision, could occur. Furthermore, weighting factors, if used, 
may be varied as a function of time of day, e.g. a profile for user 40a may be weighted more 
heavily at night than during the day when compared to the profile for user 40c. 
[0028] Other techniques are also currently envisioned. By way of example and not 
limitation, a father and daughter may both enjoy sports in general. The father may also enjoy 
entertainment options involving cooking which the daughter hates and the daughter may 
enjoy entertainment options involving music which the father does not. If the father and 
daughter are both watching television 20a, the system may generate a composite user profile, 
analyze the available television programming, and then recommend a tennis match and a 
sports news program. If the father's preferences are weighted more heavily than the daughter 
by the system, a cook-off broadcast may also get recommended even though it would not be 
recommended for the daughter if she were watching alone. 

[0029] As a further example, if a mother and her three year old child are watching together, 
in one embodiment only entertainment options that are highly recommended by the three year 
old's profile would be displayed even though those entertainment options are not highly rated 
for the mother. 

[0030] In addition to view histories, the system can use other attributes in its decision 
processes. By way of example and not limitation, weighting factors for a given user 40 may 
change based on time of day. For example, a three year old child may have the highest 
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priority in the morning, but the mother may have the highest priority in the evening. By way 
of further example, the three year old child's priority may be zero in the evening. 
[0031] Referring now to Fig. 2, when television 20a is powered on or otherwise triggered, 
such as by a timer, detection system 22 detects 110 users 40 who are within predetermined 
viewing area 11. 

[0032] Profile processor 34 then determines the identity of the detected users 40. In an 
exemplary embodiment, the identities of the detected users 40 are compared 120 against a 
set of users identities stored in persistent data store 30. As noted above, persistent data store 
30 may be a part of television 20a of may be accessible to the television 20a such as a hard 
drive on personal computer 34a operatively connected to the television by connection means 
familiar to those of ordinary skill in the data communication arts. 

[0033] Profiles for the detected users 40 are then retrieved 130 from persistent data store 30. 
Users 40 who cannot be identified or users 40 who otherwise have no accessible profile may 
be assigned a default profile 135. 

[0034] Once the profiles are obtained, a composite user profile is created 140 using all of the 
retrieved profiles. In a currently preferred embodiment, a composite user profile is created 
by first creating a composite view history 132 from each view history stored in the stored 
preferences for each user 40 identified. 

[0035] Currently, several techniques of creating a composite user profile are envisioned 
although others will be familiar to those of ordinary skill in the computer arts. In a first 
technique, all profiles gathered are combined arithmetically to create a non-weighted sum 
of all profiles of the identified users 40. Those entertainment options of the resulting 
composite user profile reflecting entertainment option preferences having the greatest 
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arithmetic value are presumed to be entertainment options having the greatest appeal to the 
users 40 in viewing area 11. 

[0036] In a second technique, all profiles gathered are combined arithmetically where the 
preferences of each detected and identified user 40 are further manipulated according to a 
predetermined weight, such as by multiplying, to create a weighted sum of all profiles of the 
detected and identified users 40. As with the first technique, those entertainment options of 
the resulting composite user profile having the greatest resulting arithmetic value are 
presumed to be entertainment options having the greatest appeal to the users 40 in viewing 
area 11. 

[0037] In a third technique, all profiles gathered are combined by including only those 
components of each profile of each detected and identified user 40 that equal or exceed a 
predetermined threshold value. All entertainment options at or above this threshold are 
presumed to be entertainment options having the greatest appeal to the users 40 in viewing 
area 11. 

[0038] From the composite user profile, the system generates 150 a set of composite positive 
entertainment options. Generation of the composite positive entertainment option set may 
be accomplished by numerous techniques as will be familiar to those of ordinary skill in the 
software programming arts including using uniform random distribution whereby a user 40 
may be allowed to select an entertainment option from a database of all available 
entertainment options for every entertainment option in the positive set. This may include 
making sure the entertainment option that has been picked is not part of the positive set and 
occurs from the same time frame, such as within a one week period. Alternatively, 
generation of the composite positive entertainment option set may be accomplished by an 
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adaptive sampling technique which selects entertainment options that are closer to the 
positive entertainment options. Methods for adaptive television program recommendations 
based on a user profile are discussed in Adaptive TV Program Recommender, U.S. Serial 
No. 09/498,271, filed 02/04/00, incorporated by reference in its entirety herein. 
[0039] In a further alternative, generation of the composite positive entertainment option set 
may use implicit techniques, explicit techniques, feedback techniques, or a combination 
thereof. 

[0040] Additionally, a set of composite negative entertainment options may be generated 155 
by sampling the database of all entertainment options. The set of composite negative 
entertainment options may be stored for future use. 

[0041] Once the sets of positive and negative programs are created, scores for each member 
of the sets may be generated 160 from the composite user profile. As used herein, "scores" 
comprises numerical values associated with each member of the sets of positive and negative 
entertainment options by which each member of the sets of positive or positive and negative 
entertainment options are able to be gauged against other members of that set and/or against 
a predetermined threshold for use in generating recommended members of the set. Scores 
may be generated using the preferences or the composite preferences. In a currently preferred 
embodiment, scores are generated only for positive entertainment options. In a further 
exemplary embodiment, recommendations may be generated from the set of entertainment 
options matching a score threshold but limited to a predetermined time frame. By way of 
example and not limitation, scores may be generated to determine which of the available 
entertainment options are to be recommended based on the plurality of users 40 by rating the 
entertainment options of a predetermined time frame against each of the previously created 
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individual profiles of each user 40 present in viewing area 11 and then presenting only the 
entertainment options that meet or exceed a predetermined rating threshold in each of the 
each of the previously created individual profiles of each user 40 present in viewing area 11. 
[0042] Additionally, one or more users 40 may be designated as having rights, such as access 
rights or supervisory rights, that are different than the rights of other users 40. By way of 
example and not limitation, a profile for a user such as user 40b may indicate that that user 
40b is enabled to alter rules and weighting methods, add or modify other profiles, or the like, 
whereas users 40a and 40c may not. 

[0043] It will be understood that various changes in the details, materials, and arrangements 
of the parts which have been described and illustrated above in order to explain the nature 
of this invention may be made by those skilled in the art without departing from the principle 
and scope of the invention as recited in the following claims. 
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